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Abstract 

We determine necessary conditions on the structure of symbol error rate (SER) optimal quantizers 
for limited feedback beamforming in wireless networks with one transmitter-receiver pair and R parallel 
amplify-and-forward relays. We call a quantizer codebook "small" if its cardinality is less than R, and 
"large" otherwise. A "d-codebook" depends on the power constraints and can be optimized accordingly, 
while an "i-codebook" remains fixed. It was previously shown that any i-codebook that contains the 
single-relay selection (SRS) codebook achieves the full-diversity order, R. We prove the following: 

Every full-diversity i-codebook contains the SRS codebook, and thus is necessarily large. In general, 
as the power constraints grow to infinity, the limit of an optimal large d-codebook contains an SRS 
codebook, provided that it exists. For small codebooks, the maximal diversity is equal to the codebook 
cardinality. Every diversity-optimal small i-codebook is an orthogonal multiple-relay selection (OMRS) 
codebook. Moreover, the limit of an optimal small d-codebook is an OMRS codebook. 

We observe that SRS is nothing but a special case of OMRS for codebooks with cardinality equal to 
R. As a result, we call OMRS as "the universal necessary condition" for codebook optimality. Finally, 
we confirm our analytical findings through simulations. 

Index Terms 

Wireless relay networks, relay selection, diversity, quantizer optimality. 

I. Introduction 

THE availability of channel state information (CSI) can greatly affect the performance and reliability 
of amplify-and-forward (AF) cooperative relay networks. With available CSI, each relay can adap- 
tively adjust its transmit power and transmit phase. This network beamforming scheme has been shown to 
achieve maximal diversity and array gains CD-El. In contrast, without any CSI at the relays, distributed 
space-time coding schemes can also achieve maximal diversity, but they also incur an unbounded array 
gain loss compared to network beamforming |@), & 

For networks with parallel relays, the optimal beamforming policy requires one or two real numbers to 
be broadcasted from the receiver to the relays. A more practical assumption is that there is only partial 
CSI at the relays. For such networks, it has been shown that beamforming with quantized instantaneous 
CSI can achieve not only the maximal diversity gain but also a very high array gain with only a few 
feedback bits 0, & 

A special case of quantized feedback for relay networks is single -relay selection (SRS) iTTTl — lf]~3Tl . which 
uses [log 2 R] feedback bits per channel state for a network with R relays. It allows only one of the relays 
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to cooperate given a constant fading block. This simple quantization scheme has been shown to achieve 
full-diversity for a very broad class of network topologies 0, lfl4l . lfT5l . and even under suboptimal 
selection criteria lfT3l . 

In this work, we consider a network with one transmitter-receiver pair and R parallel AF relays. We 
assume that there is no direct link between the transmitter and the receiver. The transmitter and the relays 
have their own short-term power constraints. We assume that the receiver has full CSI, while each relay 
knows only the magnitude of its own receiving channel and has B bits of partial CSI. The feedback bits 
are conveyed from the receiver to the relays via error-free and delay-free feedback channels, and they 
represent a quantized beamforming vector. Our performance measure is the symbol error rate (SER). 

A well-known performance measure that is closely related to SER is diversity. We define the diversity 
measure for our network model as follows: Let Pq and Pi, i = 1, . . . , R represent the transmitter and relay 
power constraints, respectively. We allow these power constraints to vary linearly with a common power 
constraint P as Pi = piP, i = 0, . . . , R, where pi are, fixed positive real numbers that are independent 
of P. Then, as P — > oo, the SER converges to aP~ d , where a and d represent the array gain, and the 
diversity gain, respectively. Since there are R independently fading paths between the transmitter and the 
receiver, the maximal spatial diversity of our network is R, which we call the full-diversity order. 

The set of all 2 B quantized beamforming vectors is the quantizer codebook. For clarity of exposition, 
we classify the codebooks under two criteria, one of which is cardinality: We call a codebook "small" 
if its cardinality is less than the number of relays, and "large" otherwise. We shall see later on that it 
is necessary to use a large codebook in order to achieve full-diversity, and correspondingly, the diversity 
provided by a small codebook is strictly less than R. 

The other criterion that we use is the codebooks' dependence on the transmitter and relay power 
constraints, the motivation of which we now explain. In general, we can optimize the codebook with 
respect to the power constraints, as demonstrated in 0. We call such power-dependent codebooks as 
"d-codebooks". Note that, an optimal codebook given some power constraints will lose its optimality as 
soon as any of the constraints are changed. Then, in order to achieve the best performance for any choice 
of constraints, the receiver and the relays need to store a possibly large number of optimal codebooks. A 
more practical approach might be to consider a power-independent codebook (i-codebook). In this case, 
a single codebook is used for all possible constraints with the purpose of achieving high diversity and 
array gains. 

The main contributions of this paper can be summarized as follows: First, we show that every full- 
diversity i-codebook necessarily contains the SRS codebook. We obtain an analogous result for power- 
dependent codebooks: As P — > oo, the limit of an optimal large d-codebook contains an SRS codebook, 
provided that it exists. Both results show that full-diversity codebooks should incorporate the SRS 
codebook structure, and are necessarily large. 

For small codebooks, we show that the maximal achievable diversity is equal to the cardinality of 
the codebook. We would like to note that, even though this result is well-known for the case of limited 
feedback beamforming in multiple-input single-output (MISO) systems lfT6l - |[T9l , its proof requires a 
completely different approach in our case. 

Having determined the best achievable diversity of small codebooks, we show that any optimal small 
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i-codebook is an "orthogonal multiple-relay selection" (OMRS) codebook, meaning that it consists of 
multiple-relay selection vectors that are pairwise orthogonal. We also show that the limit of an optimal 
small d-codebook is an OMRS codebook. Both results demonstrate the necessity of OMRS for the 
optimality of small codebooks. We believe that OMRS is also a sufficient condition for optimality, but 
rather surprisingly, a formal proof seems difficult and will not be considered in this paper. 

Finally, we observe that SRS is just a special case of OMRS for codebooks with cardinality equal to 
R. As a result, OMRS becomes the universal necessary condition for optimality. 

Our results in this paper is in contrast to limited feedback beamforming in MISO systems, in which 
any set of linearly independent beamformers guarantee maximal diversity |[T9l . and the performance of 
a codebook is invariant under unitary transformations |[T6l - lfT8l . In that sense, this paper also shows that 
the vast literature on limited feedback beamforming for point-to-point systems is not directly applicable 
to cooperative networks, and we need new methods of analysis. 

The rest of the paper is organized as follows: In Section [TTJ we introduce our system model, feedback 
and data transmission schemes, and problem definition. In Section [Till we present a fundamental lemma 
that we frequently use in our proofs. In Sections ITVl and Ivl we state our main results on the necessity of 
SRS for large codebooks, and the necessity of OMRS for small codebooks, respectively. The numerical 
results are provided in Section EH Finally, in Section IViTl we draw our main conclusions. Some technical 
proofs are provided in the appendices. 

Notation: || • ||oo indicates the infinite-norm. C, K, and N represent the sets of complex numbers, 
real numbers, and natural numbers, respectively. For z G C, \z\ indicates the absolute value. For a 
random variable X, fx(-) and Fx{-) represent the probability density function (PDF) and the cumulative 
distribution function (CDF), respectively. CN(0, a 2 ) represents a zero-mean complex Gaussian random 
variable with variance ^ per complex dimension. E[X] is the expected value of X. For any sets A 
and B, A — B is the set of elements in A, but not in B. A C B means A is a subset of B. An B 
and A U B are the intersection and the union of A and B, respectively. \A\ is the cardinality of A, 
A + = {x : x > 0, x G A}, and A r = {(ai, . . . ,a r )\a\, . . . ,a r G A}, r G N + is the cartesian power. 
Finally, is the empty set, Q(-) represents the Gaussian tail function, T(-) is the gamma function, log(-) 
is the natural logarithm, and sinh(-) is the hyperbolic sine. 

II. Network Model and Problem Statement 

A. System Model 

The block diagram of the system is shown in Fig. Q] We have a relay network with a transmitter- 
receiver pair and R parallel relays. Let f r and g r denote the channel from the transmitter to the rth relay, 
and from the rth relay to the receiver, respectively. Also, let h = (/i, <?i, . . . , fn, gn) denote the channel 
state of the entire network. We assume that the entries of h are independent and f r ~ CA/"(0, a 2 ), g r ~ 
CM(0,a 2 gr ),r = l,...,R. 

Only the short-term power constraint is considered: For every symbol transmission, the average power 
levels used at the transmitter and the rth relay are no larger than Pq and P r , respectively. Let Pi = 
PiP, i = 0, . . . , R, where oo > pi > 0. In other words, we allow the power constraints of the transmitter 
and the relays to vary linearly with P. In addition, P is the only network parameter that we allow to 
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Fig. 1. System Block Diagram 

vary. All the remaining parameters (the channel variances af r ,a gr , r = 1, . . . , R and the power constraint 
scalers p r , r = 0, . . . , R) can be arbitrary, but we assume that they are fixed positive constants that do 
not depend on P. 

We assume a quasi-static channel model, in which the channel realizations vary independently from 
one channel state to another, while within each state they remain constant. Also, we assume that the 
receiver knows the channel state of the entire network, h; and the rth relay knows \f r \. Each relay has 
also B bits of partial CSI provided by receiver feedback. 

B. Feedback Transmission Scheme 

For any P G M + and a finite number of feedback bits B, the feedback transmission scheme operates as 
follows: For each frame, the channel realization h is quantized by a quantizer Qp(h) = DECp(ENCp(h)) 
defined by the encoder and decoder mappings ENCp : C 2R — > X, and DECp : X — > Vp. In this definition, 
Vp represents the quantizer codebook for power level P, and X = {1, . . . , 2 B } denotes the index set for 
the codebook elements. We assume throughout the paper that codebooks for different power levels have 
the same cardinality, i.e. \V P \ = 2 B , VP. 

The encoding operation is performed at the receiver, and the feedback bits represent the encoder 
output. Each relay uses the decoder to find the corresponding codebook element. Each codebook element 
corresponds to a quantized beamforming vector. To summarize, we have a collection £2 = {Qp : P G 
M + } of quantizers. For a given P G M + , we use the quantizer Qp that provides the beamforming vector 
Qp(h) = x for some x G Pp. 

Let V represent the mapping that maps a power level P to its corresponding codebook Dp. With some 
abuse of language, we call the set-valued map V a power-dependent codebook (d-codebook) in the sense 
that for a given P, the codebook Vp is employed and can be optimized accordingly. Even though an 
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optimal d-codebook can provide the best possible performance at any P, its accommodation requires the 
receiver and the relays to store a large number of codebooks. A more practical approach might be to use 
a power-independent codebook (i-codebook) C as a special case of d-codebooks with Dp = C, VP. We 
will have more to say on the practicality of i-codebooks later on. 



C. Data Transmission Scheme 

We use a two-step AF protocol O, Q- In the first step, the transmitter selects a symbol s from a 
constellation S, where |<S| < oo, and sends We normalize s as E[|s| 2 ] = 1. Thus, the average 

power used at the transmitter is Pq. During the first step, there is no reception at the receiver, but the 
rth relay receives 

U = frSX^Po+Vr, (1) 

where i] r ~ CN(0, 1). 

Suppose that Qp(h) = x, for some x £ Dp. Then, the relays use the beamforming vector x to adjust 
their transmit power and transmit phase. During the second step, the transmitters remain silent, but the 
rth relay transmits 

Uf X f yj Pf ty 5 

where 

A Pr /0 s 

1 + \fr\ 2 Po 

The average power used at the rth relay can be calculated to be |av| 2 P r . We require < \x r \ < 1 as a 
result of the short term power constraint. The channel state dependent normalization factors p r ensure that 
the instantaneous transmit power of each relay remains within its power constraint with high probability. 

Also, note that within the restriction of < \x r \ < 1, p r is the maximal normalization factor that we 
can use. In other words, if a factor p" r satisfies p" r > p r for some h, then it violates the short term power 
constraint. Still, one can employ another factor p' r with p' r < p r , Vh (e.g. p' r = P r /(1 + |/r| 3 Po))- We 
shall see later in Section [III] that a different choice of the normalization factor does not change the main 
results of this paper. 

After the two steps of transmission, the received signal at the receiver can be expressed as: 

R R 

V = ^ X T ^p~^f r g r ^/P~QS + ^ Xrgry/Pr~Vr + VO, (4) 
r=l r=l 

where t]q ~ CJ\f(0, 1) is the noise at the receiver. We assume that the noises % i = 0, . . . , R and the 
channels are all independent. It follows that the received SNR is given by 

2 



Po 

SNR P (x,h) 11 



Xyr=l Xrfr9ry/p~7 



(5) 



Since we have assumed that the power constraint scalers pi are fixed, the received SNR depends only on 
P (indicated by a subscript), the beamforming vector x, and the channel state h. 
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In this work, our performance measure is the SER, and we present our results only for the case when 
S = {+1,-1} is a binary constellation. Then, the SER achieved by the quantizer Qp at power level P 
can be expressed as 



SERp(Qp) 4 £ h [QV2SNRp(Q P (h),h)]. (6) 

We would like to note that our results can be extended to any finite constellation S. 
Using ©, the diversity achieved by the collection of quantizers is given by 

A lim _1^SERHQp) 

V 7 P^oo logP 

Since there are i? independently fading paths between the transmitter and the receiver, the maximal spatial 
diversity of our network model is R. In other words, for any £2, d(i2) < R. A more formal proof of 
this argument can be found in (151 Theorem 1]. 



D. Problem Statement 

Let \T>\ represent the common cardinality of each codebook Vp. In other words, \T>\ = \Dp\ = 2 B , VP. 
We are interested in the structure of the optimal quantizers that minimize the SER subject to \T>\ = 2 B . 
The following proposition from Q determines the optimal quantizers given a fixed codebook. 

Proposition 1. Given a fixed d-codebook T> (i.e., for any P, the codebook Dp is fixed), the collection 
of optimal quantizers that minimize the SER is given by = {Qp-p> P '■ P £ where 

Q PV (h) = arg max SNR P (x,h), P G M+. (8) 

In particular, given a fixed i-codebook C, the collection of optimal quantizers is given by =£?<S = { Qp c : 
PeR + }, where 

Q PC (h) = argmaxSNR P (x,h), P G M + . (9) 

In other words, for d-codebooks, given any power level P and any fixed codebook Dp for P, the optimal 
quantizer encoder chooses the beamforming vector that maximizes the SNR at P. The interpretation of 
Proposition Q] for an i-codebook C is analogous. 

We would like to note that in practice, \Dp\ < oo, and thus argmax x6 x> p SNRp(x, h) in ((8]) will 
always exist for any h and P. In order to be able to handle codebooks with \Dp\ = oo, we shall further 
assume throughout the paper that Dp is compact for all P. Similarly, we assume that all i-codebooks 
are compact without explicit specification. 

The main motivation for our introduction of i-codebooks was the claim that they are more practical 
than d-codebooks: One does not need to store different codebooks for different power levels. On the 
other hand, © shows us that even if we use an i-codebook, the quantizer encoder will always depend 
on P. In that sense, one might argue that i-codebooks are as impractical as d-codebooks since a large 
number of quantizer encoders need to be stored anyway. Fortunately, for i-codebooks, we can observe 
from (O that the optimal encoder is a simple algebraic function of P. Therefore, we do not actually need 
to store the entire set of encoders. In order for a similar situation to hold for d-codebooks though, one 
needs a simple function that can map any power level to its corresponding optimal codebook. Finding 
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such a function is an open problem. We thus present our results for both d-codebooks and i-codebooks, 
due to the potential optimality of the former and the practicality of the latter. 

We shall use the optimal encoder in Proposition Q] for the rest of the paper. Then, the codebook uniquely 
determines the performance of the system, and we set d(T>) = d(=S^) for a d-codebook V, and similarly, 
d(C) = d(£}g) for an i-codebook C. Any optimal codebook should obey the following proposition from 
0. 

Proposition 2. IfD is an optimal d-codebook, then Dp C X, VP, where X = {x : x G C R , Hx^ = 1}. 
In particular, if C is an optimal i-codebook, then C C X. 

In other words, at least one component of every beamforming vector in the codebook should have unit 
norm. Unless otherwise specified, we shall assume that all the codebooks in the rest of this paper are 
optimal in the sense of Proposition [2] 

One simple, yet effective structured i-codebook is the SRS codebook, given by Csrs(#) = {e r (9 r ) : 
r = 1,...,R}, where 6 = [ 1 ■■■ Or], and e r (6 r ) = [ e r \(6 r ) ■■■ e r n(O r ) ] with e rq (9 r ) = 
e 3 r , r = q and e rq (9 r ) = 0, r ^ q. As an example, both 

Csrs(O) = {[ 1 ], [ 1 ], [ 1 ]} (10) 

and 

Csrs ([ f I f ]) = {[ e?* ], [ j ], [ ]} (11) 

are SRS codebooks for a network with 3 relays, where represents the all-zero vector. 

Even though there are infinitely many possible SRS codebooks given any R, all of them provide the 
same SER at any given P. This follows immediately from 

Proposition 3. For any beamforming vector x and channel state h, we have 

SNR P (x, h) = SNR P (e J ' e x, h), V0 G M. (12) 

Proof: The proof is straightforward once we use the definition of SNRp(x, h) in ([5]). ■ 

Let 'to'srs = {Csrs(#) • ^ e M. R } represent the collection of all possible SRS codebooks. It was shown 
in (3] Theorem 1] that any Csrs £ ^srs achieves the full-diversity order, R. Our first goal is to show that, 
in order to achieve diversity R, it is not only sufficient but also necessary to use SRS. To be more precise, 
it is necessary to include the SRS vectors to the quantizer codebook to achieve full-diversity. Since there 
are R SRS vectors, any full-diversity codebook has thus cardinality at least R, and is necessarily large. 

Clearly, we cannot choose the codebook cardinality freely at our will; given B feedback bits, we are 
restricted to a codebook with cardinality 2 B . As a result, one needs to use at least [log 2 -R] bits of 
feedback to accommodate a large codebook and achieve full-diversity. 

A low-rate application might require the number of feedback bits to be less than [log 2 R~\ . In this 
case, we are restricted to using small codebooks and full-diversity is no longer achievable. Optimality 
conditions for small codebooks are more complicated than the ones for large codebooks and will be 
discussed later on. 

All of our results on the necessity of relay selection will be based on a fundamental lemma that 
provides a lower bound on the SER of a given i-codebook. We introduce this lemma in the next section 
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together with some example applications. We discuss the necessity of SRS for full-diversity immediately 
afterwards. 

III. Lower Bounds on the Performance of I-Codebooks 

We frequently use the following lemma to prove the main results in this paper. The proof of the lemma 
can be found in Appendix |A] 

Lemma 1. For any i-codebook C, not necessarily with C C X, let 

&(C) = {TZ : TZ C {1, . . . , R} and Vx € C, 3r eTZ,x r ^ 0} (13) 

be a collection of index sets. Then, there are constants < ^o, Co, C\ < oo that are independent of P 
and C s.t. for all P > ^ and TZ G 3$(C), 

SERp(S^ c ) > C [e(C,^)]f exp (-^^y) P ~ W > ( 14 ) 

where £(C,TZ) = inf x6( j max rg 7^ |x r | 2 . 

Moreover, holds for any relay normalization factor p' r < p r , Vr. 

Since all of our main results will be based on the lower bound in (fT4l . and a different relay normalization 
factor will not improve this lower bound as stated in the lemma, we fix p r to be our relay normalization 
factor for the rest of the paper. 

Before we discuss the consequences of Lemma Q] regarding the necessity of relay selection, let us first 
present a motivating example application. As an immediate corollary to Lemma [T] the following theorem 
provides an upper bound on the diversity provided by any finite-cardinality i-codebook. 

Theorem 1. For any i-codebook C with \C\ < oo, d(C) < min{|^| : K G M{C)}. 

Proof: Since (O holds for any TZ G M(C), we choose the set TZ' in g%{C) with the smallest 
cardinality (if the number of such sets is more than one, we can choose any of them). By definition, 
£(C,TZ') is a positive constant that is independent of P. It follows from Lemma Q] that SERp(Qp C ) > 
C [£(C,TZ')] 3 / 2 exp(-Ci/£(C,TZ'))P-\ n '\, VP > * - Thus, C provides at most a diversity of \TZ'\. ■ 
The rest of this section is devoted to some example applications of this theorem. 

Example 1. For a network with 3 relays, let 

Ci = {[ 1 1 ]}, (15) 
C 2 = {[ 1 1 ], [ 1 1 ]}, (16) 
C 3 = {[ 1 1 ], [ 1 1 ], [ 1 1 ]}. (17) 

Let us first find an upper bound on the diversity provided by C±. Using the definition in (fT3l . we have 
&{d) = {{2}, {3}, {1,2}, {2, 3}, {1,3}, {1,2, 3}}. Then, according to Theorem^ d(d) < 1 since 

min{|7e| : TZ G M{C{)} = min{|{2}|, |{3}|, |{1, 2}|, |{2, 3}|, |{1, 3}|, |{1, 2, 3}|} (18) 

= min{l,l,2,2,2,3} (19) 
= 1. (20) 
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Similarly, d(C 2 ) < 1 since M(C 2 ) = {{3}, {1, 2}, {2, 3}, {1, 3}, {1, 2, 3}} and thus mm{|7£| : K G 
&{C 2 )} = 1- O n tne other hand, the "best" that we can say about the diversity of C3 is that d(Cs) < 2 
since ^(C 3 ) = {{1, 2}, {2, 3}, {1, 3}, {1, 2, 3}} with min{|ft| : K G M{C^)} = 2. □ 

Example 2. None of the codebooks C\ , C 2 and C3 in Example Q] can achieve the maximal diversity 
order 3. Now, suppose that a finite-cardinality i-codebook C 4 achieves diversity 3. Then, we should 
have {1,2}, {1,3}, {2, 3} ^ M{C±) (otherwise, if e.g., {1,2} G ^(C 4 ), then according to Theorem [Q 
d(C 4 ) < 2). Now, since {1,2} ^ ^(C 4 ), by the definition of M(-) in ([13]), 3x = [x 1 x 2 x 3 ] G C 4 s.t. 
I^il = \ x 2\ = 0. Also, as a result of Proposition |2l | ^3 1 = 1, and thus 38^ G R s.t. X3 = e je3 . In 
other words, x = 63(^3) is an SRS vector. Similarly, using the conditions that {1,3} ^ ^(C 4 ) and 
{2,3} G' ^(C 4 ), we can show that 38 2 G R, e 2 (6> 2 ) G C 4 and 36>i G R, ei(6>i) G C 4 , respectively. 
Therefore, only if 3Csrs G ^srs s.t. C S rs C C 4 , we can have d(C 4 ) = 3. But, we also know from (3] that 
VCsrs e ^srs> if Csrs C C 4 , we have d(C 4 ) = 3. Hence, for a network with 3 relays, a finite-cardinality 
i-codebook can achieve diversity 3 if and only if it contains an SRS codebook. In Section UV] we shall 
generalize this result to networks with any number of relays that employ codebooks with possibly infinite 
cardinality. □ 

Example 3 (Comparison with MISO Systems). One of the most surprising conclusions that we can draw 
from Theorem Q] is that, unlike a MISO system, in a relay network, (i) the performance of a codebook can 
significantly vary under unitary transformations, and (ii) the existence of linearly independent codebook 
vectors do not guarantee maximal diversity. We have demonstrated the latter phenomenon by codebooks 
C 2 and C3 in Example Q] Despite the fact that C 2 and C3 consist of 2 and 3 linearly independent codebook 
vectors, respectively, we have d(C2) < 1 and d(C 3 ) < 2. 

We now demonstrate the former phenomenon. For that purpose, let C • U = {xU : x G C} denote the 
transformation of the codebook C by a unitary matrix U. 

In this example, we consider networks with a sum-power constraint P on relays. For such networks, 
the rth relay transmits with power |rE r | 2 P given a beamforming vector x, and we require X^=i l x r| 2 -P < 
P =>• ||x|| < 1. The sum-power constraint on relays makes sure that if C is a feasible codebook, then 
for any unitary matrix U, the codebook C • U is also feasible. 

Let us now consider the transformations of the codebook Csrs(O) in (fTOb by the unitary matrices 

1+3 l-3j -V2 + jV2 



Ui 



-J- -i- 
-J- J_ n 

V2 v/2 



and U2 = - 

4 



-3-j 1-j V2 + jV2 
V2 + jV2 V2 + jV2 2 + 2j 



(21) 



3 

Note that the codebooks Csrs(O) ■ Ui and Csrs(O) • U2 consist of the rows of U 4 and U2, respectively. 

For limited feedback MISO systems with independent and identically distributed transmitter-to-receiver 
channels lfT6l - |[l~8l , the performance of a quantizer codebook is invariant under unitary transformations. 
Moreover, even in the case of arbitrary channel variances, the diversity of a codebook is preserved under 
unitary transformations. On the other hand, for our example network, the application of Theorem Q] yields 
d(CsRs(0) - Ui) < 2, and d(CsRs(0) -^2) < 1, whereas d(CsRs(0)) = 3. In general, unless U is diagonal, 
it can be shown that d(CsRs(0) • U) < 2. Therefore, in relay networks, even the diversity performance of 
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a codebook is not preserved under unitary transformations. This unexpected behavior can be attributed 
to the non-linear nature of the distortion function as well as the noise amplification at the relays. □ 

IV. The Necessity of SRS 

With Lemma Q] at hand, we can now introduce our results on the necessity of relay selection. In 
this section in particular, we determine the structure of optimal quantizers that achieve the full-diversity 
order, R. First, we consider the power-independent i-codebooks, and show that every i-codebook that 
achieves full-diversity necessarily contains the SRS codebook. We then focus on d-codebooks that can 
be optimized with respect to the power level P, and show that an optimal large d-codebook contains an 
SRS codebook asymptotically as P grows to infinity. 

A. The Necessity of SRS - I-Codebooks 

In Example [2] in Section [Till we showed that an i-codebook for a network with 3 relays can achieve 
full-diversity if and only if it contains an SRS codebook. The following theorem generalizes this result 
to networks with any number of relays that employ codebooks with possibly infinite cardinality. 

Theorem 2. For any i-codebook C, d(C) = R if and only if 3C S rs £ ^srs s.t. Csrs C C. 

Proof: The "if" part was proved in Q. Here, we prove the "only if" part by contradiction. Suppose 
there is a compact i-codebook C with d(C) = R and VCsrs G ^srs> Csrs is not a subset of C. The latter 
condition implies that 3r G {1, . . . , 12}, \/6 r , e r (9 r ) ^ C (as otherwise, Vr G {1, . . . , R}, 3i} r , e r ($ r ) G C 
and thus Csrs([$i ' ' ' $r]) C C). In other words, C does not contain the vector(s) that selects the rth relay. 

Let 75 — {e r (9) : 6 G R}. Note that 75 is the product of the closure of the unit disk by the all-zero 
vector of dimension 12—1. Since all the factor sets are compact, 75 is compact. 

We now show that 

3e > 0, Vt G 75, Vx G C, ||x - t|| > e. (22) 

Let (x',t') = argmin( xt ) 6Cx 7- 2 ||x — t||. The minimum will always exist as C x 75 is compact and 
/(x, t) = ||x — t|| is continuous. Moreover, since C n 75 = 0, we have x' ^ 75, and thus ||x' — t'|| > 0. 
Therefore, we can pick e.g. e = i||x' — t'|| > 0, and (f22l will hold. 
According to d22l . for any x G C, we have 

R 

\x r -e je \ 2 + ^2\x q \ 2 >e 2 ,V6eR. (23) 

9=1 
q^r 

Also, since x G X, it follows that 3r' G 1Z, \x r >\ = 1. If r' = r, we choose 9' = Z.x r >. Then, 
(l23l ==> J2q^ r \ x q\ 2 > g2 =^ niax g ^ r \x q \ 2 > (R — l) _1 e 2 . Otherwise, if r' / r, then 3q ^ r, \x q \ = 
1 ==> max 9 ^ r |x g | 2 = 1. In either case, max g? t r |x,j| 2 > eo, where eo = min{l, (12 — l)~ 1 e 2 } > 0. 

Now, let U = {1, . . . ,12} - {r}. Clearly, U G ^(C). Moreover, £{C,U) = inf xe c max^ |x g | 2 > e . 
Using Lemma [TJ SER P (Q* C ) > Coe^ 2 exp(-Ci/e )P" |w| , VP > * - Therefore, d(C) < |W| = 12 - 1, 
which contradicts the assumption that d(C) = 12. This concludes the proof. ■ 

Therefore, an i-codebook can achieve diversity 12 if and only if it contains an SRS codebook. 
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B. The Necessity of SRS - D-Codebooks 

Let us now consider the necessity of SRS for power-dependent d-codebooks. In this paper, we are 
interested in the asymptotic structure of optimal d-codebooks as P grows to infinity. As we have mentioned 
in Section Hl-Cl we can interpret any d-codebook T> as a set-valued map that maps the power level P G M + 
to the codebook Vp C X C C . Therefore, we use the well-established limit definitions for set-valued 
maps ll20ll to characterize the asymptotic structure (or the limit) of any d-codebook. 

Definition 1 (See, e.g. |20l Definition 1.4.6]). Let V be a d-codebook. For any P andxe C R , let 

dp(x) = min ||x — y || (24) 



as the distance of x to T>p. The minimum in ([24]) always exists since T>p is compact for all P. 
We now define 



limsupPp = jx G C R : liminf dp (x) = ol (25) 
as the upper limit ofDp as P — > 00, and 

liminf V P = jx G C R : lim d P (x) = ol (26) 

P— >oo I P— >oo 

as the lower limit ofDp as P — > 00. The upper and lower limits always exist for any given T>. 

If liminf p^oo Dp = limsupp^^ Vp = C, i.e. if the upper and lower limits agree, we say that the 
d-codebook converges to C and write limp^oo Dp = C. 

We also use the shorthand notation liminf T> = liminfp_ 5 . 00 Dp, limsupP = limsupp^^ T>p, and 
similarly, limP = limp^ooPp. 

Given Theorem [2l we expect intuitively that the limit of any full-diversity d-codebook V contains an 
SRS codebook provided that lim V exists. The following theorem, whose proof can be found in Appendix 
iBl verifies this intuition: 

Theorem 3. The following arguments hold for any d-codebook T> with d(T>) = R. 

1) There are R distinct beamforming vectors e r) p, r = 1, . . . , R in Dp s.t. for all P > ^3, 

\e r ,p, g \ 2 < 7^5, Vg € {1, . . . , R} - {r}, r = l,...,R, (27) 
log P 

where e r ,P,q represents the qth component ofe T) p, and < ^3,(73 < 00 are constants that are 
independent of P and T>. 

2) If lim T> exists, 

a) If \T>\ = R, 3C SRS G ^ S rs s.t C SRS = lim V. 

b) // |X>| > R, 3C SRS G ^ SRS s.t. C SRS C limD. 

3) If lim T> does not exist, 3Csrs G ^srs s - t- Csrs C lim sup T>. 

Since we can achieve full-diversity using the SRS scheme, any SER-optimal large d-codebook should 
achieve full-diversity as well. In that sense, the necessary conditions that we have stated in Theorem [3] 
hold for optimal large d-codebooks as well. 
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Also note that the rate of convergence indicated in (|27T ) is only a necessary condition. In other words, 
a sequence of codebooks satisfying (|27T ) do not necessarily provide maximal diversity. We conjecture that 
a necessary and sufficient rate of convergence is p- instead of ^-p stated in the theorem. 

In Theorem [3l we have also taken into account codebooks that may fail to converge. This is not a 
limitation of the analysis that has been carried out: There exists optimal d-codebooks that do not converge 
as we demonstrate by the following proposition: 

Proposition 4. For any R and B < oo, there exists an optimal d-codebook T> with \T>\ = 2 B that does 
not converge. 

Proof: We prove the proposition for the trivial case R = 1 and give a sketch of the proof for R > 1. 
For R = 1, the received SNR is given by 

SNR P (x,h) = i + |/i|2po + |gi|2pi . (28) 

Hence, at any P, it is sufficient to use a single beamforming "vector" [x] with \x\ = 1 to achieve the 
best SER performance; it is needless to use a codebook with cardinality greater than 1. As an example, 
a d-codebook V with Dp = {[1]}, VP is SER-optimal. 

Let us now define another d-codebook V' as V' p = {[— 1]} if n < P < n + 1 for some nonnegative 
integer n, and V' p = {[1]}, otherwise. Note that V provides the same SER performance as V. On the 
other hand, it is straightforward to show that limsupP' = {[1], [—1]}, and liminf T>' = 0, and hence 
lim V' does not exist. 

In general, for any R and a finite B, we can synthesize a non-convergent optimal d-codebook out of 
a convergent optimal d-codebook V as follows: If n < P < n + 1 for some nonnegative integer n, we 
replace a beamforming vector x € Dp by e je x for some 9 £ R, and otherwise, leave it unchanged. As 
a result of Proposition |3l the new d-codebook provides the same performance as V, and is thus optimal. 
However, it fails to have a limit due to the artificial phase oscillations that we have introduced. ■ 

In this section, we have shown by Theorems |2] and [3] that one needs to include all the SRS vectors to 
the quantizer codebook to achieve full-diversity. This requires the accommodation of a large codebook, 
or equivalently, at least [log 2 R~\ bits of feedback. On the other hand, the design constraints might require 
that the number of available feedback bits is less than [log 2 R~\ , in which case we are restricted to using 
small codebooks and full-diversity is no longer achievable. Our goal in the next section is to determine 
the optimal codebook structure for such low feedback rate applications. 

V. Small Codebooks and the Necessity of OMRS 

In this section, we first determine the maximal achievable diversity with small codebooks. Then, we 
find the optimal small codebook structure that can achieve maximal diversity. We show that a diversity- 
optimal small i-codebook should contain multiple -relay selection vectors that are pairwise orthogonal, i.e. 
it should be an OMRS codebook. We also demonstrate the necessity of OMRS for small d-codebooks. 
Finally, we observe that SRS is actually a special case of OMRS for codebooks with cardinality equal 
to R. Therefore, OMRS becomes the universal necessary condition for codebook optimality. 
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A. Diversity Limitations of Small Codebooks 

The following theorem shows that the maximal diversity provided by any small codebook is equal to 
the cardinality of the codebook. 

Theorem 4. For any d-codebook V, &(T>) < min{P, \T>\}. 

Proof: Let us first prove the theorem for an i-codebook C. For any x € X, let t(x) € {I, . . . ,R} 
be any index with \x L r x )\ = 1- Note that as a result of Proposition 12 t(x) always exists whenever x is a 
member of a quantizer codebook. 

Now let Ta = {t(x) : x € C}. Note that \%\ < mm{R, \C\}, % G M{C), and £(C,7i) = 1. Using 
Lemma [T] VP > we have 

SER P (Q^ C ) > C 4 P HTj| (29) 
> C4^ min{i? ' |C|} , (30) 

where C4 = Coexp(— C\). Thus, d(C) < min{P, \C\}, concluding the proof for i-codebooks. 

One way to deal with the complications that arise from the power-dependency of d-codebooks is to 
define a lower bound that treats each codebook T> g , g € M + as an i-codebook. At a given P, we can 
calculate the SERs of all V Q , g G IR + . The infimum of these SERs then gives us a lower bound on the 
performance of V at P. With this observation, VP > ^0, we have 

SERp(Q* PVp ) > inf sm P (Q* PV ) (31) 
> inf c 4 p- min{R > m (32) 

= C 4 P" min{ - R ' PI} , (33) 

where (l32l follows from (l30l) . This concludes the proof. ■ 
There are structured small codebooks that can achieve the diversity upper bound in Theorem |4] As 
an example, for an i-codebook C' SRS (d, 0) = {ej(0j), i = 1, ...,d} that contains d < R SRS vectors, 
d(C' SRS (d, 6)) = d, \/0, as shown in Q. In other words, an "incomplete" SRS scheme, in which the 
selection of only a subset of the relays is considered, can achieve maximal diversity. What is left is thus 
to determine the structure of a general diversity-optimal small codebook. Unlike large codebooks where 
SRS is the only way to achieve maximal diversity, we show in the following that for small codebooks, 
a more general OMRS structure can potentially provide maximal diversity. 

B. OMRS 

The necessity of SRS for large codebooks "generalizes" to the necessity of OMRS for small codebooks. 
Let us first describe what we mean by OMRS in a more formal manner. 

Definition 2 (OMRS). An i-codebook C is an OMRS codebook if and only if either \C\ = 1, or Vx, y £ 

C. y ^ x, Ylr=i \ x A\yr\ = 0- OMRS is the scheme induced by an OMRS codebook. 
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In other words, an OMRS codebook contains multiple-relay selection vectors that are pairwise orthog- 
onal§ As an example, C 5 = {[0 1 0.8], [0 1 0], [1 0]} is an OMRS codebook. 

By definition, the cardinality of an OMRS codebook cannot be more than R. An OMRS codebook 
that has cardinality equal to R should be familiar: it is an SRS codebook. 

C. The Necessity of OMRS - 1-Codebooks 

Now let us demonstrate the necessity of OMRS for i-codebooks by the following theorem: 

Theorem 5. A diversity-optimal i-codebook C with \C\ < R is an OMRS codebook. 

Proof: The case \C\ = 1 is ttivial. We prove the other cases by contradiction. Suppose that there 
exists a non-OMRS i-codebook C with 1 < \C\ < R and d(C) = \C\. Since C is not an OMRS, 3x,y G 

C, y 7^ x, 3r G {1, . . . , R}, \x r \ / 0, \y r \ / 0. Now, let % = {r} U (t(z) : z G C - {x, y}}, where t(z) 
is any index that satisfies \z L ^\ = 1. Note that \7i\ < \C\ — 1, %, G ^(C), and £(C, 7s) = min{|x r |, \y r \}- 
Applying Lemma [H we have d(C) < \C\ — 1. This contradicts the assumption that d(C) = \C\. ■ 

In other words, an i-codebook C with \C\ < R achieves diversity \C\ only if it is an OMRS codebook. 
In particular, if \C\ = R, d(C) = R if and only if C is an OMRS codebook, in which case it is also an 
SRS codebook. Unlike the necessity and sufficiency of SRS for large codebooks, we can only show the 
necessity of OMRS for small codebooks. We leave the sufficiency as a conjecture: 

Conjecture I. If a small i-codebook C is an OMRS codebook, d(C) = \C\. 

D. The Necessity of OMRS - D-Codebooks 

Let us now generalize our result on the necessity of OMRS for i-codebooks to d-codebooks by the 
following theorem. Its proof can be found in Appendix ICl 

Theorem 6. Let &{c) denote the collection of all possible OMRS codebooks with cardinality c. The 
following arguments hold for any optimal d-codebook D with 1 < \T>\ < R. 

1) There are constants < Cq, 9q < oo that are independent of P and T> s.t. for all P > \&6. 



2) If limV exists, 30 G 0(\V\) s.t. O = limP. 

3) IfYrniV does not exist, 30 G &(\V\) s.t. O C limsupP. 

Therefore, any two distinct beamforming vectors in an optimal d-codebook V with \V\ < R are 
asymptotically orthogonal, and thus V converges asymptotically to an OMRS codebook. In particular, 
for codebooks with cardinality equal to R, Theorem [6] provides the same arguments as Theorem [3] This 
follows from our previous observation that an OMRS codebook with cardinality equal to R is also an 
SRS codebook. 

'Note that this orthogonality condition is not the same as the "usual" orthogonality condition for complex vectors with respect 
to the Hermitian inner product. 




(34) 
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From all the results that we have obtained up to now, we can conclude that OMRS is a universal nec- 
essary condition in the sense that for any SER-optimal d-codebook V, there exists O £ ff(mm{R, \T>\}) 
s.t. O C limsupP. In other words, as P grows to infinity, the upper limit of every optimal codebook 
should contain an OMRS codebook with the largest possible cardinality. 

VI. Numerical Results 

In this section, we provide numerical evidence regarding the validity of our analytical results. For all 
the figures, the horizontal and the vertical axes represent P, and the SER, respectively. 



A. Diversity Bounds for Finite-Cardinality I-Codebooks 

In Fig. |21 we show the simulation results with i-codebooks for a 3-relay network with power constraints 
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1, pi = 0.5, P2 = Pz = 2, and channel variances a\ 
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- 1.7, <Tg 3 = 0.7. The codebooks C\, C2, and C3 are as defined in (fT31 ). ([Tol . and (fTTT ). respectively. 
Oi = {[10 0], [0 -0.8 1]} is an OMRS codebook, and C S rs represents an arbitrary SRS codebook. 
Csrs " Ui and Csrs • U2 represent the transformations of an arbitrary SRS codebook by the unitary 
matrices Ui and U2 in (1211 ). respectively. Note that all SRS codebooks provide the same SER at any 
given P, as we have discussed in Section III-DI and as shown by Proposition [3] Similarly, given any 
unitary matrix U, all the codebooks Csrs • U, Csrs 6 ^srs provide the same SER at any given P. 
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Fig. 2. SERs with Different I-Codebooks. 
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We can observe from Fig.|2]that d(Ci) < 1, d(C2) < 1, and d(Cs) < 2, verifying TheoremQ] Moreover, 
both codebooks seem to actually achieve their diversity bounds dictated by the theorem. This suggests 
that Theorem Q] also provides an accurate estimate on the diversity of any finite cardinality codebook. 
Also, 0\ yields second order diversity as we have conjectured, and Csrs provides full-diversity. 

We have analytically shown earlier in Example [3] that unlike a MISO system, in a relay network, 
(i) the performance of a codebook can significantly vary under unitary transformations, and (ii) the 
existence of linearly independent codebook vectors do not guarantee maximal diversity. Regarding the 
latter phenomenon, Fig.[2]demonstrates that even though C2 and C3 consist of 2 and 3 linearly independent 
codebook vectors, respectively, we have d(C2) < 1 and d(Cs) < 2. For the former phenomenon, despite 
the fact that d(CsRs) = 3, we have d(CsR.s ■ U2) < 1 and d(C SRS ■ Ui) < 2, as we can infer from Fig. 
|2] Hence, in relay networks, even the diversity provided by a codebook is not preserved under unitary 
transformations. 

As a final remark for this set of simulations, we would like to note that we have chosen the power 
constraint scalers and channel variances in a random manner so as to demonstrate the validity of our 
results in "asymmetric" scenarios. We have obtained similar results for other (including identical) choices 
of these parameters. 



B. The Necessity of SRS 

Let us now demonstrate the validity of Theorems [2] and [3] for a network with R = 2. We assume that 
the power constraint scalers and the channel variances of the network are equal to unity. In this set of 
simulations, we use a special type of codebook that we define in what follows: For any < e < 1, let 

C(e, r) = {x : x G X, \x r \ 2 > e}. (35) 

In Fig. [3l we show the SERs for our 2-relay network with i-codebooks C(e,r), e = 1, |, r = 1,2, 
Csrs ; X, and the d-codebooks V r = C(j^p,r), r = 1,2. Note that, as a result of our choice of the 
network parameters, the SER with C(e, 1) is the same as the SER with C(e, 2) at any given P. Similarly, 
the SER with T>\ is the same as the SER with T>2 at any given P. 

We first demonstrate the validity of Theorem 12 Since {r} G £%(C(e,r)), and £(C(e, r), {r}) = e, by 
Lemma[D C(e, r) provides at most a diversity of 1 for any fixed e > 0. This is precisely what we observe 
in Fig. [3] In general, we expect a similar behavior for any given e > 0. Thus, if we use an i-codebook C 
with either C C C(e, 1) or C C C(e, 2) for some e > 0, C will not be able to provide diversity more than 
1. In other words, if C C |J e>0 C(e, 1) or C C |J e>0 C(e, 2), then d(C) < 1. Hence, if C* is an i-codebook 
that achieves diversity 2, then 3e^, e£ G C* s.t. 



e>0 



= p| [C(e, 1) C = p|{x G X : \ Xl \ 2 < e} = {x G X : |asi| = 0}, (36) 

and G {x G X : \x2\ = 0}, where C c = X — C. Note that and e\ are SRS vectors. Therefore, if C* 
achieves full diversity, it should contain an SRS codebook. This verifies Theorem |2] 

The verification of Theorem [3] is analogous: Let V* denote an optimal d-codebook, and ep = sup{e : 
T>p C C(e, 1) or Vp C C(e, 2)}. Since V* is an optimal d-codebook, it achieves full-diversity. Thus, 
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Fig. 3. An illustration of the validity of Theorems [2] and [3] for R — 2. 



using the same arguments in the previous paragraph, ep — >■ as P — >• oo. On the other hand, by the 
definition of ep, we have 3x* p £ 2?p s.t. |x* Pr | 2 < ep + e' rP , r = 1,2, where e' r P > can be chosen 
arbitrarily. Let us choose e' r P = ep, r = 1,2. Then, we have |x* Pr | 2 < 2ep, r = 1,2. This shows the 
existence of two beamforming vectors in Dp, namely x* p and P , that converges to two distinct SRS 
vectors as P — > oo. This verifies the limit arguments in Theorem [3] 

Theorem [3] also provides an estimate on how fast ep should decay. The performance of the d-codebooks 
T>\ and T>2 in Fig. [3] demonstrate that the decay should be no slower than j^-p, and thus verifies the 
theorem. On the other hand, since both codebooks do not provide maximal diversity, the estimate of 
Theorem [3] might be rather loose. 



C. The Necessity of OMRS 

We now demonstrate the validity of Theorems [5] and [6] for a network with R = 3. We assume that 
the power constraint scalers and the channel variances of the network are equal to unity. Our goal is to 
determine the structure of optimal codebooks that have cardinality equal to 2 and thus provide a diversity 
of 2. For that purpose, similar to what we have done in Section IVI-Bl we use the special i-codebook 
C(e,r) as defined in d35l ). 

In Fig.|4l we show the SERs for our 3-relay network with i-codebooks C(e, r), e = 1, |, ^, r = 1, 2, 3, 
Csrs> X, and the d-codebooks V r = C(^p,r), r = 1,2,3. As a result of our choice of the network 
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parameters, for a given e, the SERs with C(e, 1), C(e, 2) and C(e, 3) are the same at any given P. Similarly, 
the SERs with T>\, T>\ and 2? 3 are the same at any given P. 




5 10 15 20 25 

P (dB) 



Fig. 4. An illustration of the validity of Theorems [3] and [6] for R= 3. 

We first demonstrate the validity of Theorem |2 We can observe from Fig. [3] that C(e,r) provides at 
most a diversity of 1 for any fixed e > 0. In general, we expect a similar behavior for any given e > 0. 
Thus, if we use an i-codebook C with C C C(e,r) for some r G {1,2,3} and e > 0, then d(C) < 1. 
As a result, using the same arguments in Section IVl-BI if d(C*) = 2, then 3y r G C* s.t. y* G {y G 
A? : \y r \ = 0}, r = 1,2,3. In other words, for any r G {1,2,3}, there exists a beamforming vector in 
C* = {x^x?;} with a vanishing rth component. Therefore, Ylr=i \ x ir\\ x 2r\ = which means that C* is 
an OMRS codebook. This verifies Theorem [5] 

In order to verify Theorem [6l let V* with V* p = {x^ p , P }, P G R and \V*\ = 2 denote an optimal 
small d-codebook, and ep = sup{e : 3r G {1,2,3} s.t. Dp C C(e, r)}. Since V* is optimal, it achieves 
second order diversity. Using the same arguments in the previous paragraph, ep — > as P — > oo. On 
the other hand, 3y* p G Vp s.t. \y* Pr \ < \/2ep, r = 1,2,3, by the definition of ep. As a result, 
Er=l\ x *lrp\\ x *2rp\ ^ 6ep, VP G R, and =1 \ x i r p\ \ x 2 r p\ — ^ as P — )■ oo. In other words, the 
two beamforming vectors in V* p should become asymptotically orthogonal. Finally, the performance of 
the codebooks T> r , r = 1,2,3 in Fig. 0] demonstrate that ep should decay no slower than j^-p- These 
verify Theorem [6l 
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VII. Conclusions 

We have determined some necessary structural properties of symbol error rate optimal quantizers 
for limited feedback beamforming in wireless networks with a single transmitter-receiver pair and R 
parallel amplify-and-forward relays. We have shown that any power-independent codebook (i-codebook) 
necessarily contains an orthogonal multiple-relay selection (OMRS) codebook with the largest possible 
cardinality. In particular, if the cardinality of the codebook is no less than R, an i-codebook achieves 
maximal diversity if and only if it contains the single -relay selection (SRS) codebook. We have obtained 
similar results for the general case of power-dependent codebooks (d-codebooks): An optimal d-codebook 
should contain an OMRS codebook with the largest possible cardinality, asymptotically as the transmitter 
powers grow to infinity. 

Appendix A 
Proof of Lemma Q] 

Note that 1Z ^ 0, since if 72. = then x = 0, Vx G C, contradicting Proposition 
Using ([5]), for any set of indices 1Z ^ and relay normalization factors p' r < p r , Vr, the SNR with 
any beamforming vector x G C, can be upper bounded by 

SN Rp(x, h) < R^ZtllXrfrM (37) 
1 + Er=l \ x r9r\ 2 Pr 



< "t^fl : (38) 



RPq Sr=l \ x rfr9r\ 2 P r 
1 + Y,r=l \ x r9r\ 2 Pr 

RV fl KI 2 IM 2 Po|g,-l 2 - 

n 2^r=l l+|M 2 Po 

i , V R \x r \i\g r \ 2 P r 
1 "I" Z^r=l l+|M 2 Po 



(39) 



where the first and the second inequalities follow from Holder's inequality, and the fact that p' r < p r , Vr, 
respectively. The proof of the lemma for R = 1 is now straightforward. If R = 1, we have \x±\ = 1, Vx G 
C, and thus £(C,K) = 1 for any C and K (indeed the only available K will be K = {1}). Using ([39]>, 
we have SNR P (x, h) < 1 ^fp^f g ^ Pi < \fi\ 2 P . Since this final upper bound is the SNR of a fading 
channel with single transmitter and receiver antennas, we have SERp(Q PC ) > CjP" 1 for some constant 
< CV < oo independent of P. 

For R > 2, we shall further bound SNRp(x, h). For the numerator of d39l , we have 



R J2 l^| 2 |/,| 2 P |9r| 2 ^ ^ „^ \fr\ 2 Po\9r\ 2 Pr 



Jr ^0 </r r r , KM 'Oaf r ' r ^ t> ST^ I |2 D ^ d2 i |2 D 

TTWPO ~ ^ l + \fr\ 2 P0 ~ ^ 

= R 2 Pm&x{a 2 r cr~ 2 \g r \ 2 p r } < R 2 m.&x{p r a 2 } P max Z r . (40) 
where Z r = <j~ 2 \g r \ 2 . Note that Z r ~ r(l, 1). Now, for the denominator of d39l , 

fi |„ |2|„ |2p « |„ |2| n |2p |_ |2p 
i , X - ^ rr I i/r- 1 1 r ^ V"^ I r \ I i/r- 1 1 r - . .a ■ yr - 1 r 
1+7 ,,,„„ > > , ,,„„ > max i r mm , - lo — 

^ l + \fr\ 2 P l + |/r| 2 P0 - r 1 r| r 1 + |/ r | 2 P 

l2 min re 7e |o r | 2 P r max r |x r | 2 mm r {p r cr 2 }Pmin r Z r 

^> jq^x x (4 1 ) 

r r max re7e (l + |/ r pp ) " max{ i )PomaXr(T 2 } ^ + P^ rG7e< r7 r 2 |/r| 2 ) ' 
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Now let V = YZ with Y = ± + Erett ^l/rl 2 and z - ifflf- Usin § <SD and (gOjl in the final 
upper bound in (l39l . and then taking the supremum over all possible x G C, we have 



SNR P (Q£ )C (h),h) <C 8 P1/, (42) 

where C 8 = ^(C,^)] _1 C 9 is a finite constant with £(C,ft) is as defined in the statement of the lemma, 

r^} max r {p r (T^}/ min r {p r a^ 



and Cg = R 2 max{l,po max r ah } m&x r {p r a 2 } / mm r {p r a 2 }. Note that since Cg > 1 and £(C, 7?.) < 1, 



we have Cs > 1. 

Now, substituting (l42l to ©, we have 

oo 

SERp(Qp c ) > y Q(V2C 8V P)/(f)d V . (43) 
o 

In the following, we find a lower bound on the PDF of V = YZ. Since Y is the sum of R independent 
r(l, 1) random variables and a constant -p, it follows a "shifted" gamma distribution: 

^ = rW e ( y "pJ ' y -^ (44) 

Now, let us evaluate fz{z). Note that for z < I, Fz{z) = 0, and thus /z(-z) = 0, z < 1. For z > 1, the 
CDF of Z can be expressed as Fz(z) = P(E) where E is the event that max r Z r < zmin r Z r , with 
Z r = \g r \ 2 . Moreover, E is the union of R(R — l) disjoint events Eu, i / j, i,j G {1, ... ,R}, where E,, 
is the event that Zi = mmZ r , Zj = maxZ r , Z^ G [0, oo), Zj G (Zj, zZi], Z^ G (Zi, Zj), k ^ i, k ^ j 
Since Z r are identically distributed, and each Ey has the same probability, for z > 1, we have 

oo xz y y 

F z (z) = R(R-l) J J j "... j e- x -y-^Hdwidydx 

x x x 1 

R—2 integrals 



(45) 



R(R-l) J j e- x - y {e- x -e- y ) R - 2 dydx (46) 

x 

oo xz R~2 

R(R-l) J J e~ x - y ]T ~ j (-l) r e~ yr e-^ R - 2 - r ^dydx (47) 

x r=0 

(r nv7 fi " 2 ^ (~ 1 ) r ^~ 1 ) 

1 r Jfl+(z-l)(l+r) 

oo R—2 

(z _l) (jR _l) [ e -x(R+(z-i))J2 ( R ~ 2 )(-l) r e- rx ^dx 

oo 

(,-l)( fl -l,/e-<-<-).(l-e-<-))-dx 



(48) 
(49) 



o 

oo 

"s(z - 1) 



2^ 2 (z-l)(i?-l) Je- x ^smh R - 2 



o 

2 We ignore the events that have zero probability, e.g. the event that max Z r = min Z r 



(50) 



dx (51) 
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" W + (52) 

= m ( 53) 

where (|47T ) follows from the binomial expansion of the term (e~ x — e~ y ) R ~ 2 in (l46l ). In order to obtain 
(l49l ). we have rewritten the denominator of the fraction in d48l in integral form by using the identity 
f™e- ax dx = i, a > 0. Also, © is a result of the fact that £^r o 2 (-l) r /3 r = (1 - /3)* _1 for 
< ft < 1, and (|52]> follows from (ZD Eq. 3.541.1]. In order to derive ([53]) from d52i we have used 
the identity T(l + x) = xT(x), x G R, which implies r(,R + -^) = (R-l + -£i)T{R - 1 + ^) = 



We can now find the PDF of Z using (1531) . We have 

fz(z) = §-/z{z) (54) 




-T(R) d 

-r(E) Am 1 ttV ^ 



(55) 



-m) y -R n£i 1 (g+ A) r57 . 

2^ ^_n2 _ , _r ^ 



r(i? + i)E^i 1 (r + A" 1 



(58) 



r( fl + i)v:f:/(fl + ^ 

- (^-D 2 nt- 1 l («+^ I ) 

(fl-i)r(iz + i)(z-i)«- 2 
= «s ( 6 °) 

Now, we find a lower bound on the PDF of V = YZ. It can be shown |[22l that the PDF of V is given 
by f v (v) = fz(x)f Y (§) jjydx. Substituting the PDF of Y in ®, and the lower bound in © on 
the PDF of Z, we have 

vP 

... (R- l)T(R+ 1) f/v l\ |Khl r . M (i-1) R - 2 , 



i 



R(R-l) f f vP-1 \ lnhl ( w(vP-l) \ R+1 ( w + vP \ 3 



> (K-mR + D (^lY +m -\-^ 1 ^ 2 dw (63) 

- R R r(\n\) \ vP J J (i + w) R +\K\ aw > {0V 



where we have applied a change of variables w = vF pZ^ to obtain (l62l ). and (l63l follows from the 
facts that exp(- I f^L) = exp^^^) > exp(-t,), and (^^y) 3 > ^(^) 3 - 
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_ In R+\Tl\-3 . . 

/vW>C 10 — - e-^W" 1 , (64) 



The integral in (1631) is non-zero and finite for R>2. Thus, 

P- 
~vP 

for some constant < C±q < oo. 

Combining (l43l . (l64l . and using the fact that Q(x) > -^= 1 _^ z2 exp(— ^-), we have 

s^) , H /V.-,-. (^) fi+IK| -^ e — dl , (65) 

P 

OO 



^P\K\ J (1 + w) R -2 2C 8 w + 1 + 2C 8 K ' 





-1-C, 



" (1 + 2C7 8 )^Pl^l y v 1 

o 

where the equality follows from a change of variables w = vP — 1. The second inequality follows from 
C 8 > 1, and the assumption that P > 1. Now let us find a lower bound for the integral in (I67T ). i.e. 

J 4 f °° e-^w^l + w)-Tdu;, where a = 2C 8 , /3 = R + - 3, and 7 = i? - ±. Note that a, 7 > 
and p > 0. We have 

1 00 
/ = y e- au, u; /3 (l + u')- 7 du; + J e~ aw w 13 (1 + w)^ dw 



(68) 



1 

00 



1 



(69) 



> 6 " 2 7 + 2" 7 / e-^^-^-^du- (70) 



1 + /3 

1 

00 

e -a 2 - 7 



> + 2~T / e-^e-^^+^du; (71) 

" 1 + /3 



(72) 



1 + /3 a + 7 + /3 

ol-7 p -(a+7+/8) 

> " " n (73) 

- 1 + Q + 7 + /3 

Substituting the values of a, /? and 7 to (|73T ). and combining with (I67T ). we have 



Since C 5 > 1, and 2R + - § > for all i? > 2 and 1 < < i?, we have 



SEMQ ^ * (HWl 2C 8 + 2fl + |tt|-§ (74) 



SERp(Q ^ c) " 3^ C 8 (2i2 + |tt|-i) • (75) 
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Finally, using the fact that 2R+ \1Z\ — ^ < 3R on the denominator of the second fraction in (l75l) . we can 
show that CEJ) holds for any R with constants C = mm{C 7 , C 10 C 9 ~ 3 / 2 2 3 / 2 ~ R exp(-3i?+|)/(9 J R 1 /^)} 
and C\ = 3Cg that are independent of C and P. This concludes the proof. 

Appendix B 
Proof of Theorem [3J 

We carry out the proof in two parts: First we prove d27l ). and then the limit arguments in the statement 
of the theorem. 



A. Proof of UB 

For notational convenience, let -dp = SERp(Q PT)p ). Also, let ^ = {{1, . . . , R} — {r},r = 1, . . . , R}. 
Using Lemma [T] we have 

VP>* ,VTG^ W,T)>^% =► ti P > ,^ 2( ; l) ! }■ (76) 
This, using logical transposition, is equivalent to 

VP>%We^,(tfp< ,^ 2Cl) ! =► e(o Pl T)<^V (W) 

I pl T l+2logiP log^J 

Since tfp < p ^g| p =► <?p < /nlf^p , VP > 1, it follows from CZ3 that 

vp>$ 7 ,vrg^,L< ^ o(2Cl) 3 f =► £Pp,t)<^%1, (78) 

I P R -2logiP logPj 

where ^7 = max{l, \^o}. It was shown in (3j that 

VCsrs € ^ S rs, SERp(Q^ Csas ) < diP- R , VP > * 8> (79) 

where < C\\, < 00 are constants that are independent of P. This upper bound on the SER with 
Csrs holds for any optimal codebook of cardinality at least R. Thus, 

Vp < C U P- R , VP > * 8 . (80) 

Moreover, there exists a constant < < 00 that is independent of P s.t. 

diP- fl < c R oi ? Ci) : ,vp>^ 9 . (si) 

P R ~2 log'- P 

Combining (l80l and (I8TI ). we have 

< ^° (2Cl l 2 , VP > max{* 8 , * 9 }. (82) 

P R ~2 log 3 P 

Letting \&io = max{^7, ^9}> an d noting that the left hand side of the implication in (|78T ) does not 
depend on 1Z, we have 

VP > *i , $p < C R ° {2Cl) 3 VP > * 10 , VT E ^, e(X> P , T) < (83) 

P^loe* p logP 
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According to (1821 ). the left hand side of (1831 ) is true. But (1831 ) itself is true. We thus have 

VP>*n, vre^, SpprfKr-^, (84) 

log P 

where $n = maxj^io, exp(^j-)}. Note that we have also further restricted the power levels that we 
consider by choosing P > exp(^j-) so that < 0.6. 
Now, consider a fixed \Pi2 > $n. According to (l84l) . 

2C 

Vr G {1, . . . , R}, 3e r G P* 12 , Vg G {1, . . . , R} — {r}, \e rq \ 2 < + e, (85) 

logP 

where e > can be arbitrary and e rq represents the qth component of e r . Let us choose e = j^p- Note 
that, with this choice of e, any \e rq \ 2 in (f85l ) satisfies |e rg | 2 < 0.9 < 1. 

We now show by contradiction that e, ^ ej whenever i ^ j. Suppose that e.j = ej with i ^ j. 
Then, |ej r | 2 < 1, Vr, which contradicts the optimality of T>^ 12 due to Proposition [2] Therefore, for 
any > ^n, there should be R distinct vectors e r , r = 1, ... ,R in £>^ 12 with the rth satisfying 
\e rq \ 2 < i^p, V<? G {1, . . . , R} - {r}. This concludes the proof of (T27T ). 

5. Proof of the Limit Arguments 

We can now prove the limit arguments in the statement of the theorem using (|27T ). 
Let £ = {x G X : \x\\ = 1} represent the set of all SRS vectors that selects the first relay. First, we 
show that 3e G £ s.t. e G limsupp^^ Dp. 
Using (T27T ). we have 

/ 'iA I P _ 1 ^ 

(86) 




and therefore, mm e6 £ <ip(e) < 4/ 3C \ogP ^ ■ K follows that 

lim min dp(e) = 0. (87) 

P— >oo ee£ 

Now, let ep = min e6 £ dp(e), and e* , n G N be a sequence of beamforming vectors. Since e* G £, Vn 
and £ is compact, by the Bolzano- Weierstrass theorem, the sequence e*, n G N contains a subsequence 
e*., i G N with lim^oo = e* for some e* G £. 

Note that for any y G C R , ||y — e*|| < ||y — e n J| + ||e* — e n J| by triangle inequality. It follows 
that min y6 x) ni ||y - e*|| < miny^. {||y - e n J + ||e* - e n J|} = mm ye x) n . ||y - e n J| + ||e* - e n .||. 
Rearranging the terms, we have eZ n . (e*) — d ni (e*.) < ||e* — e*.||, Vi G N, and thus 



liminf (d ni (e*) - ^(e*.)) < liminf ||e* - e* || (88) 
The equality follows from the fact that lim^oo e*. = e*. 



0. (89) 
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We now have 

liminf dp(e*) - limsup dp(ep) = liminf dp{e*) + liminf (-dp(ep)) (90) 

P— >oo p—^oo P— >oo P— >oo 

< liminf (d P (e*) -d P (ep)) (91) 

P— >oo 

< liminf (d ni (e*)-d ni «)), (92) 

< 0, (93) 

where d9TT > follows since 

liminf fix) + liminf g{x) < liminf {fix) + g(x)) , (94) 

x— >oo x— >oo x— >oo 

for any functions / and g. For d92l ), we have used the fact that the lower limit of a sequence is less than 
the lower limit of any of its subsequences. For d93l ), we have used d89l) . 

Now, since liminf p-^ dp(e*) — limsupp^^ dp(ep) < as shown in the derivation above, we have 

liminf dp(e*) < limsup dp(ep) = limsupmindp(e) = 0, (95) 

P^oo P->oo P^oo e e£ 

where the last equality follows from (l87l) . Therefore, liminf p^oo dp(e*) < 0. On the other hand, obvi- 
ously we have liminf p_>oo dp(e*) > 0. Combining the two inequalities yields liminf p^oo dp(e*) = 0. 
This shows the existence of an SRS vector e £ 6 (namely e*) that selects the first relay and satisfies 
liminfp^oo dp(e) = 0, or equivalently, e £ limsupp^^ Dp. We can similarly show the existence of the 
remaining R— 1 SRS vectors in the upper limit of V. Therefore, BCsrs £ "^srs s.t. Csrs C limsupp^.^ Pp. 

What is left is to show that if \V\ = R, and limp_ s>00 'Dp exists, we have 3Cg RS £ ^srs s.t. Cg RS = 
limp^oo Dp. We have shown that C' SRS C limsupp^^ Pp. If limp^oo Dp exists, then limsupp^^ Vp = 
limp^oo Vp, and thus C' SKS C limp^oo Vp with | limp^oo Vp\ > R. To complete the proof, it is therefore 
sufficient to show that | limp^oo Pp| < R. 

The following lemma shows that when limp_ 5 . 00 Pp exists, its cardinality cannot be more than \V\, 
and thus concludes the proof of the theorem. 

Lemma 2. For any d-codebook V with \V\ < oo, if limp^oo Vp exists, then | limp_ >00 'Dp| < \V\. 

Proof: Let C = limp^oo Vp. Suppose that \C\ > \V\ + 1. Then, 3x$, . . . ,xp| +1 £ C, with Vi, j £ 
{1, . . . , \V\ + 1}, Xj 7^ Xj <J=^> i ytz j. Since C = liminf p-^oo Vp as well, we have Vi £ {1, . . . , \V\ + 1}, 
limp—^oo min y6 x> p ||y— Xj|| = by the definition of liminf p^^ V P . This implies that Mi £ {1, . . . , \ V\ + 
1}, Ve > 0, 3Pi >e > s.t. VP > p je , min ye x> P ||y — < e. Letting P e = maxj Pj >e , we have 

Ve > 0, 3P e > s.t. VP > P £ , Vi € {1, . . . , |P| + 1}, min ||y - Xi || < e. (96) 

yeDp 

Now, let 

5 = min llxj — x 7 -||, (97) 
i,je{i,...,\T>\+i} 

set e = 6/4, and consider a fixed Pq > P5/4. Also, let y, = argmin ye x> Po ||y — Xi||, i = 1, . . . , |P| + 1. 
Since |Pp | = \V\, y^ = yi = y for some 7^ £. Note that, as a result of (|96l ) and the definition of y, 
we have ||y — Xfc|| < 5/4 and ||y — x^|| < 5/4. 
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However, by triangle inequality, ||x£ — x^|| < ||xfe — y|| + ||x£ — y|| < 5/4 + 5/4 = 5/2, and this 
contradicts (l97l) . Therefore, the cardinality of £ cannot be more than \T>\, concluding the proof. ■ 

Appendix C 
Proof of Theorem [6] 

Similar to what has been done in the proof of Theorem [3) we carry out the proof in two parts: First 
we prove (l34l . and then the limit arguments in the statement of the theorem. 



A. Proof of 63 

Let £? represent the collection of all subsets of {1, . . . , R} with cardinality no greater than \T>\ — 1. 
Then, using the same ideas as in the proof of Theorem we have 

VP > ^13, VT" G 2T , £(T>p, T) < 7—7^5 (98) 

logP 

for constants < C12, ^13 < 00 independent of P. Let us set the constants in the statement of the 
theorem as C% = RC12 and VE^ — ^13- We now prove (l34l by contradiction. Suppose that (l34l is 
false. Then, 3* 14 > ^ 6 = * 13 , 3x,y G C, x / y, Y^Li \ x r\\Vr\ > ^p- This implies that 3r G 
{1,...,R}, \x r \\y r \ > ig^. Hence, either we have \x r \ > {^p) l/2 or \y r \ > {^p) 1/2 . 

Now, let Tq = {r} U {l(z) : z G T>y 14 — {x, y}}, where l(z) is any index that satisfies \z^\ = 1. 
Since \%\ < \V\ - 1, T 6 G 3T. Also, either max teT6 \x t \ 2 > ^ or max te7 - 6 \y t \ 2 > More- 
over, Vz G X>* 14 — {x, y}, max t6 r 6 |^t| 2 = 1 by the construction of %. Therefore, ^(D^ 14 , 7ei) 



infxgx)^ max te 7^, |x t | 2 > i^rp- But, this contradicts d98l) , and thus concludes the proof of (l34l) . 



5. Proof of the Limit Arguments 

We can now prove the limit arguments in the statement of the theorem using (l34b . 

Let = {01, . . . , 0|d|} represent an OMRS codebook given a beamforming codebook cardinality 
1 < |X>| < R. For any OMRS codebook O, we define its "vectorized" version vec(O) = [01 ■ ■ ■ 0|<p|] as 
an alternative representation for O. Also, let O = (Joe^ vec (C) represent the collection of all vectorized 
OMRS codebooks. 

We now need the following lemma to proceed: 

Lemma 3. For any Dp that satisfies 3o G O s.t. min ye:D ii3| ||o — y|| < ^^^p^ ■ 

Proof: Let Vp = {xi, . . . , xi-pi}. For convenience, we rewrite the condition in ( f34b as 

R 

max > IxjJ \xj r \ < 5, (99) 

where 5 = j^p- Now, d99l) implies that for all i, j G {1, . . . , \V\} with i / j we have |xj r ||a;j r | < 
5, Vr G {1, . . . , R}. Then, given any r G {1, . . . , R}, either |x.j r | < V5, \/i G {1, . . . , \V\}, or there 
exists only one index i* G {1, . . . , |X>|} s.t. |xi*, r | > V^, and \xi r \ < a/<5, Vi G {1, . . . , |£>|} — {i*}. 
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Let us now define the function / : C — > C with f(x) = xif\x\> ^/~5, and f(x) = 0, otherwise. 
Now, let Oi r = f(xi r ), % = 1, . . . , |X>|, r = 1, . . . , R. As a result of the properties of / and Xj r , not only 
o G D is an OMRS codebook, but also, 



mm 1 1 o — y|| = mm 



R PI 



J2J2\o lr ~ Vir\ 2 (100) 



» \ r=l j=l 



< 



< 



PI 



a |o ir - x ir \ 2 (101) 

\ r=l i=l 



R 



J2p\ s2 ( io2 ) 

= y/B\D% (103) 

and this concludes the proof. ■ 
In other words, if V is an optimal d- codeb ook, for all P sufficiently large, we can find an OMRS 
codebook ogD s.t. o is as close as Ce ^Jp^ to Vp. We thus have 

lim inf min lly — oil = 0. (104) 

p^oo oee> yg x>if i 

We now prove that O is a compact set so that we can replace the infimum in (11041 ) by a minimum. 

Lemma 4. D is compact. 

Proof: It is sufficient to show that D is bounded and closed. Since D C X^ and X\ v \ is bounded, 
O is bounded. We prove that O is also closed by showing that it can be expressed as the union of a 
finite number of closed sets. First, we need the following definitions: 

• Let V represent the set of all vectors [ ax ■■■ am\ fix •■• Pr-\d\ ] that satisfy the following: 

1) ax, a\ v \, Px, Pr-\v\ are positive integers. 

2) 1 < qi, . . .,a\ v \ < R. 

3) Vi,j€{l,...,|2?|}, on^aj^i^j. 

4) 1 < Px,...,Pr-\v\ < 

Note that |V| = R(R - 1) • • • (R - \V\ + l)\V\ R -\ v V 

• Let DISK = {x G C : ||x|| < 1} and CIRC = {x G C : ||x|| = 1} represent the unit disk and the unit 
circle, respectively. 

• Given v = [ ax ■ ■ ■ a\-p\ fix • • • Pr-\v\ \ e ^> l et represent the collection of all vector- 
ized codebooks [ xi • • • xix>i ] = [ xxx ■ ■ ■ xxr ■ ■ ■ £|x>|,i ■ ■ ■ x \v\,R ] w i tn tne follow- 
ing properties: 

1) Vz G {1, . . . , \V\}, x iai G CIRC, Vj G {1, . . . , \V\] - {i}, x j(Xi = 0. 

2) Vz G {1, . . . ,R — \V\}, xp. y . G DISC, Vj G {1, . . . , R - \V\} - {/%}, x hi = 0, where 71 < 
• • • < 7fl-p| satisfy {71, . . .,Jr-\t>\} = {1,...,R}- {ax, . . -,a\ v \}. 

According to these properties, for any given v G V, X v can be expressed as a finite cartesian product 
of the closed sets DISC, CIRC and {0}. Hence, X v is closed for any v. 
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It is straightforward to show that 3t v is a set of OMRS codebooks for any given v G V, and thus 
vev ==> o G D. Each v G V actually corresponds to a particular OMRS structure. As an 
example, for R = 2 and |£> | = 1, let w = [ 1 3 1 1]. Then, 3_ w is the union of all OMRS codebooks 
of structure [ x\\ x± 2 x\4 x 2 3 ], where xn,x 2 ^ G CIRC and xi 2 ,x\4 G DISC. 

We now show the converse, i.e. o G D =^ o G UveV-^v- Consider some o G D. We shall 
construct a v = [ a\ ■ ■ ■ ap P\ ■ ■ ■ Pr-\v\ ) £ V s.t. o G X v . Since o is an optimal codebook, 
by Proposition |2 at least one component of every beamforming vector in o has unit norm, and thus we 
choose the in such a way that |oj a J = 1, or equivalently, oi a . G CIRC. Also, since o is an OMRS 
codebook, we have Oj Qi = 0, Vj ^ i by definition. This satisfies the first property in the definition of 
3^v ■ 

Now, let 7i < • • • < 7it_.pi satisfy {71,. . . ,7i?_p|} = {1, . . . ,R} - {a lt . . . ,a\ v \}. For any given 
7i, there are two possibilities: 

1) Xj 7i = 0, Vj G {1, . . . , In this case we can pick any 1 < /?, < \V\. 

2) Since o is an OMRS codebook, there is at most one non-zero x J7! , j = 1, . . . ,\V\. Suppose that 
Xjij. / 0. Then, we set fii = j'. 

This satisfies the second property in the definition of 3t v . Therefore, for the particular as and /3s we 
have chosen, o G X v , and thus in general o G D =^ o G UveV ^v- Combining this with the fact that 
OGU vev % v = ^ G ® ' we nave & ~~ UveV Hence D is the union of a finite number of closed 
sets. Therefore, it is closed, and this concludes the proof. ■ 
Hence, we can rewrite dl04|) as 

lim min min lly — oil = 0. (105) 

p->oo oeo y ez>if 1 

Note that this equality has the same form as (l87l ). Using the exact same steps as in Appendix |B] we can 
show that 

3o* G D s.t. liminf min ||y - o*|| = 0. (106) 



Now, we have 



= liminf min ||y — o*|| (107) 
> liminf min [| — o*|| (108) 



P^oo 



yex^ 1 y/\V\ ^ 



\v\ 

= liminf min ••• min > lly,- — o?|| (109) 



|P| P^oo yiefp y\-D\£D, , 



|D| 

= liminf > min lly,- — o*|| (110) 



1 PI 

> — ; > liminf min lly* — o?!!, (Ill) 

1=1 



where (11081) follows from Holder's inequality. For (111 lb . we have used 
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Finally, using (111 II) . \/i £ {1, . . . , 1^1}, we have limmfp_ s . 00 mm y& x> P ||y — o*|| = 0, or equivalently 
o* G limsupp^^Pp. This shows the existence of an OMRS codebook O* £ ^ > (|£ ) |) s.t. O* C 
limsupp^oQ Pp. If the limit exists, according to Lemma [2j O* = limp^oo Dp, concluding the proof. 
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